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].  Introduction.  Let  X  ,  X  .....  X  be  identically  and 
- — •  i  .  i  n 

Independently  distributed  random  variables  (i.i.d.r.v.)  with 
distribution  function  F;  we  discuss  the  compos i te' goodness-of-f I t 
test  given  by  the  test  of  Ho:  F  e  F  versus  the  alternative 
Ha:  F  e  F  -  F  ,  where  F  is  some  large  class  of  distributions  and 

F  is  a  parametric  family  to  be  tested.  For  example,  F  may  be 

o  • 

the  family  of  exponential  distributions  and  F  the  family  of 


conti nous  d i s t r i bu t ions . 

Many  test  procedures  are  based  on  characterizing  properties 
of  the  family  F  .  taking  the  form:  a  statistic  T(X  .....  X_;  F  ) 

*  Q  ■  -  -  |  II  0  * 

has  distribution  Q,  where  Q  is  a  unique  distribution  function,  i  f 

and  only  if  F  £  f  the  statistic  T  and  the  distribution  Q  may  be 
■  —  ■  "  "  "■  ‘  0 

univariate  or  multivariate.  An  example  is  a  t rans f ormat i on  from 

X  .....  X  to  a  statistic  T  »  (Z  - - Z^) ,  (m  <  n),  where  the 

*  i 

statistics  Z.  are  un i forms  i.e.  i  i  d  with  the  uniform  distribution  j 

between  0  and  1,  v/hich  we  shall  write  u(0,l),  or  where  Z.  are  ordere 

uniforms ,  i.e.  distributed  like  a  random  sample  from  U(o,l)  which 

has  then  been  placed  in  ascending  order.  Examples  of  these 

transformations  are  the  Conditional  Probab i 1 i ty  In teg ra ?  Tran  forma 1 1 

(CPIT)  discussed  In  O’Reilly  and  Quesenberry  (1973)  and  in  Rincon 

Gallardo,  Quesenberry  and  O’Reilly  (1979)  which  g i ve  -uni  forms  and 

the  J  and  K  transformations  In  Seshadri ,  Csorgo  and  Stephens  (19^9) 

which  transform  exponential  random  variables  to  a  sample  of  ordered 

For  other  examples  of  characterizations  see  Prohorov  (13 
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uni  forms . 


and  Seshadriand  Csorgo  (19&9)*  In  particular,  the  final  step  in 
the  test  of  Ho  is  usually  to  calculate  a  test  statistic 

based  on  the  values  of  T,  and  compare  with  its  distribution 
under  Ho.  The  "if"  part  of  the  characterization  above  gives  what, 
is  usually  referred  to  as  the  distribution-free  property  of  T. 

If  the  "only  if"  part  fail.s,  meaning  that  it  might  have  distribution 

£ 

Q  for  some  F  e  F  -Fo,  it  then  follows  that  a  test  of  Ho  based  on  T 
will  have  power  equal  to  the  significance  level  a  for  detecting  the 

JL 

alternative  F  .  For  a  good  test  therefore,  a  charact e r i za t i on  is 
needed . 

Invariant  Characterizations.  Even  when  a  characterization  of  F 
- - - — ■ — - -  0 

forms  the  basis  of  a  test,  the  values  in  T,  and  the  value  of  T 

1 

calculated  from  T,  may  depend  on  the  order  in  which  the  original 

x.  are  indexed.  When  this  is  not  the  case  v/e  say  that  the  charac 

1  “ 

terization  is  ?  nva  riant;  then  all  statisticians  following  the  test 
procedure  will  obtain  the  same  value  of  the  test  statistic,  and  In 
general  this  has  an  intuitive  appeal. 

In  this  paper  we  concentrate  on  the  problem  of  testing 

for  the  exponential  distribution;  F  is  the  family  with  members 

0 

F  (x)  -  1  -  exp  ( - x/0)  ,  x  >  0  ,  with  0  >  0  unknown.  Two 

Important  character izat ion  procedures  studied  by  Seshadrl  Csorgo 
and  Stephens  (1969),  called  J  and  K  transformations,  are  based  on 
characterizations;  J  i.s  not.  invariant,  but  K  is,  and  these  authors 
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show  that  K  is  superior  in  terms  of  power.  Thus,  more 

support  is  given  to  use  invariant  characterization  procedures,  at 

least  for  the  exponential  case. 


It  therefore  seems  worthwhile  to  develop  a  systematic  approach 
which  gives  an  invariant  characterization.  This  is  done  in  section 
3  by  means  of  the  CPIT.  The  details  are  worked  out  for  the 
exponential  test,  and  it  is  shown  that  the  subsequent  characterization 
is  connected  with  K  while  the  usual  CPIT  is  connected  with  J. 

We  investigate  these  procedures,  and  a  variant  of  K  ,  by  means  of 
power  studies.  They  extend  and  support  the  results  of  Seshadri , 

Csorgo  and  Stephens  (1969).  Thus  a  good  approach  to  providing 
structure  in  goodness-of-fi t  procedures  seems  to  be  the  search  for 
invariant  characterizations.  Unfortunately,  the  general  application 
of  the  invariant  CPIT  will  be  difficult  computationally,  and  we 
conclude  the  paper  with  some  comments  on  these  problems. 


2.  Transf ormat ions  involving  characterization.  Throughout  the 

paper,  we  employ  the  following  notation.  The  r.v. 

will  denote  an  unordered  exponential  sample  whereas  X(t)*  X(2) 


n 


•  •  •  I 


X/  *  will  denote  the  corresponding  sample,  ordered  in  ascending 
(n) 


Similarly  Z  ,  Z  ,...,Zn  will  denote  an  unordered  U(0,1) 
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order . 


sample  and  will  stand  for  the  corresponding  ordered 

^  ^  ^  <A  «jU 

sample.  When  necessary,  X^,  . XR  and  Z^,  . will  also 

denote  .unordered  exponential  and  u(0,l)  samples  respectively. 

The  following  transformations  which  are  characterizations 
in  a  sense  specified  in  each  case,  are  well  known  and  can  be  traced 
In  several  places  in  the  literature.  See  for  example,  Sukhatne 
(1373),  Galambos  (1975),  Ahsanullah  (1978)  and  Stephens  (1378). 

The  J  and  K  transf romat ions  are  those  used  by  Seshadri  ,  Csorgo  and 
Stephens  (19&9).  We  give  the  transformations  in  symbolic  form 
where  the  meaning  is  obvious. 

The  J  transfo  rma t ion  .  This  transforms  n  random  exponentials 
Into  n" 1  ordered  uniforms. 


(xi,x2,...,xn)  -[j 

J*  (Z(l)’Z(2)’***’Z(n-1) 

,  J  V 

n 

with 

2<j)  - 1  *  Xl>  ' 

(I  X j)  ,  j=l , . . .n-1 

v _ e 

The  i.i.d.  nonnegative  r.v.  X  ,X  f...,X  with  positive  mean  are 

|2  ” 

exponentially  distributed  if  and  only  If 

are  distributed  as  an  ordered  sample  of  size  (n-1)  from  t)(0,1). 


The  H  transformation.-  (Sukhatme,  1937).  This  changes  an  ordered 


exponential  sample  into  a  unordered  exponential  sample  with  new 
values. 


wi  th 


<Xti)  *X  ti)  •  ■••X(n)>  "Q*  °VX* . Xn> 

w*t*1  ?  j  "  (n+1-j)  ^x(j  )“x  (j_|) )  »  (X^  jSO) 

For  *X/2j  » • • • |X  ,  the  unordered  i.f.d.  nonnegative 

r.v.  X^§  X2***#,Xn  with  positive  mean  are  exponent ia) ly  distributed 

*  *  £ 

If  and  only  if  ,X^, . ,  .  ,X^  are  i*i»d.  r.v.  exponentially  distrfbu 
ted. 


The  E  transformation."  This  changes  an  ordered  uniform  sample  Into 
an  unordered  uniform  sample  w I th  new  values. 


(Z(»)  ,Z(2) - 2(n)}  -13]"  (VV*'*»Zn) 


With  Zj  85  *Z(j)  /  Z(j  +  1)^  *  j  =  ,.-*-.n  ^2(n  +  1)E1^ 


2»  *Za  *  *  * 
U(0.1). 


For  Z  /  j  ,2  , . .  ♦  tZ  ^n)  ,  the  unordered  i.I.d.  r.v. 

,,Z  are  U(0,1)  If  and  only  If  Z*,Z*,...,Z*  are  I.I.d, 
n  12  n 


Another  two  transformations  which  are  obvious  characterlza 


tlons  will  be  needed, 


The  1  transformation.-  This  takes  a  uniform  sample  into  a  new 
uniform  sample  by  substracting  each  value  from  i. 
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4  ■ 


mmw  * •*  *rf 


wl  th 


(Z  ,Z 
1  2 


v  *n>  <<•<• 


*  j«1 


n . 


The ..K  transformation.-  This  takes  an  exponential  sample  to  a  new 
sample  by  reversing  the  indexing  of  the  original  values*  The  new 
sample  therefore  has  the  same  values  as  the  old. 


(VX* . Xn}  ■’'Fj'*  (VX*.....X*) 

with  X*  =  xn_j  +  1  »  j  =  1 , .  . .  ,n 

The  K  transformation.-  The  K  transformation  is  equivalent  to  first 
using  N  and  then  using  J.  Thus  K,  like  J, transforms  into  n-1 
ordered  uniforms, and  we  write  symbolically  K  =  J  o  N  . 


By  construction  K  is  an  invariant  characterization  whereas 
J  is  only  a  characterization.  The  power  studies  reported  by  Seshadri , 
Csorgo  qnd  Stephens  { 1 969)  for  a  wide  variety  of  uniformity  tests 
that  follow  the  transformation,  show  the  clear  superiority  of  K. 
Horeover,  it  is  also  noted  that  J  produces,  for  some  alternatives, 
transformed  values  that  are  more  evenly  spread  in  the  unit  interval 
than  if  they  were  uniformly  distributed;  these  are  called  superuni¬ 
forms  ,  and  arise  for  example,  when  J  maps  samples  from  a  half-normal 
distribution.  J  and  K  are  connected  with  a  un  i  forms-to-un i forms 
procedure  first  critically  examined  by  Durbin  (19<>1)  and  called  G 
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by  Seshadri  , Csorgo  and  Stephens  (1969).  Both  G  and  E  have  the 
property  that  they  transform  superuni forms  into  a  set  which  is 
more  clustered,  and  more  likely  to  be  detected  by  usual  tests  of 
uni formi ty. 


The  CPIT  transformation  C .  -  |  n  O'Reilly  and  Quesenberry  (1973)  a 

transformation  is  proposed  that  produces  (n  —  1 )  unordered  uniforms 
Z  ,2  ,...,Z  -  from  n  unordered  exponentials  X  ,X  .  The  aim 

•  *  it  i  j  2  n 

of  such  a  transformation  is  to  change  the  problem  of  testing 
exponenti al  1  ty  to  that  of  testing  uniformity.  In  that  paper, 
the  general  CPIT  procedure  is  given  and  is  illustrated  for  several 
families.  It  is  not  shown  that  the  procedure  yields  a  characteri¬ 
zation  in  general,  and  due  to  its  construction,  it  is  not  an 
invariant  procedure.  For  the  exponential  case,  the  CPIT  trans¬ 
formation  is  given  by 


wl  th 


<V\ . Xn>  <VZ, . 2„-,’ 

Vi  ■ 1  •  1  - 


and  It  can  easily  be  seen  that  this  is  the  composition 


C  •»  T  o  E  o  J.  Hence  for  the  exponential  case  C  yields 
a  character i zabi on  which  is  not  invariant. 
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The  Wang  and  Chang  tronsformat ion  W.-  Recently,  Wang  and  Chang- 
0977)  have  proposed  the  use  of  a  characterization  of  the  exponen 
tlal  distribution,  by  means  of  a  transformation  W  to  a  uniform 
sample  given  by 

<v\ . V  *0*  (v*t . Vi> 

j  j+1  j 

with  Z,  «  {  (  E  X.)  /  (  Z  X.)  >  , 

J  i  =  l  *  i  =  l  * 

it  fs  easily  seen  that  W  **  E  o  J,  and  again  is  a  charac 
terization  which  is  not  invariant  (Wang  and  Chang  (1977),  give  an 
Independent  proof  of  the  characterization). 


3.  An  invariant  CPIT.  The  idea  behind  the  CPIT  procedure  is  to 
apply  the  multivariate  t  rans  f  or.-a  t  ion  due  to  Rosenblatt  (-1952)  to 
the  conditional  distribution  of  the  sample  given  the  minimal  suf¬ 
ficient  statistic  S  for  the  family  under  consideration.  In  that 
way  a  set  of  independent  uniforms  is  obtained.  Since  Rosenblatt's 
transformation  requires  absolute  continuity  of  the  mu  1 1 i var ia te 
distribution  and  since  the  conditional  distribution  of  the  whole 
sample  given  S  is  necessarily  singular,  one  is  forced  to  seek  the 
maximum  number  of  terms  in  the  sample  for  which  their  conditional 
distribution  given  S  is  absolutely  continuous  (almost  surely).  In 
that  way  one  gets  the  maximum  number  of  uniforms. 


8 


If  in  this  procedure,  instead  of  considering  the  conditional 
distribution  of  ,X^ ( . . . ,X^  (the  sample)  given  S,  we  actually  consider 
the  conditional  distribution  of  *(,  )  »*(2  )  »  *  •  •  »X(n)  given  S,  then  the 
resulting  transformation  will  be  invariant.  This  procedure  will  be 
referred  to  as  the  invariant  CPIT  (ICPIT). 


In  what  follows  the  ICPIT  is  worked  out  for  the  exponential 
case.  Many  of  the  attractive  properties  that  are  found  in  dealing  with 
this  case  are  due  to  the  features  of  the  exponential  distri¬ 
bution.  Nevertheless,  the  procedure  outlined  could  prove  useful  in 
other  cases  as  well,  and  other  families  are  currently  being  studied. 


In  order  to  apply  Rosenblatt's  transformation  to  the  condi¬ 
tional  distribution  of  as  many  order  statistics  as  possible  wh i l e 
retaining  absolute  continuity,  it  is  proposed  that  this  maximum  number 
should  be  n-1,  just  as  in  the  ordinary  CPIT. 


Let  S  stand  for 
n 

Sw/  for  I  X,  .x  ,  etc.  S 
i=3  K  1 


(*> 

i 

stat i st i c. 


n  /a  n 

I  X.,  and  also  let  S1*'  stand  for  E  Xf.», 
i  =  1  '  t**2 

is  in  this  case  the  minimal  sufficient 


Suppose  that  the  conditional  distribution  of  X/  ) '*(*) *  *  *  *  ** 
evaluated  at  x  (  , ) *x  ( 2 ) *  * • • »x (n_ j )  given  S  is  absolutely  continuous 
a.s.,  and  denote  it  by  Fn  4  )  »x  (2  )  *  •  *  *  »x  (n_  j  j  )  • 
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Applying  Rosenblatt's  transformation  in  this  conditional 
setting,  requires  the  computation  of  the  marginal  and  conditional 
distributions,  Kn(*(j)>.  *»<*(,)  I*  (,,)••••  j  U  (t) . x{„.2)! 


which  are  afterwards  used  to  produce  the  independent  U(0,1)  trans- 

i 

) 


forms,  Zi-Fn(X(j))  .  Z^Fn  (X  (  f  }  |  X(j  }  ) . Zn- <X (n- 1 ) !X ( ! ) 


(n-2) 


If  all  of  the  conditional  distributions  and  the  marginal 
distribution  employed  arc  absolutely  continuous  a.s.,  then,  the  joint 
Fn  *  (i ) * ’ *  * ,X (n- 1 ) ^  *s  abso,ute,y  continuous  a.s.  and  viceversa,  so 
it  will  suffice  to  verify  the  absolute  continuity  a.s.,  of  the  (n-l) 
proposed  distributions. 

Fn(x(i))  may  be  computed  directly  or  by  means  of  Bayes'. 

formula  since  the  conditional  distribution  of  X/  .  qiven  S  can  be 

(1)  s 

expressed  In  terms  of  the  conditional  distribution  of  S  given  X/ 

Vl  ) 

and  the  distribution  of  S,  and  these  are  well  known.  After  doing 
the  algebra  we  have 


fn  <x(i)>  - 


j: 


if 


(i 


nx(i) 


(i) 

/s) 


<  o 

n-l 


If 


(i) 


If 


x(») 


G  (O.S) 
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The  next  step  is  to  obtain 


thus  Z^®  1-  (1-nX^j/S)  .  The  next  step  is  to  obtain 

Fn  (x  (*)  lX  (j  )  )  *  w**'ch  's  P^*(2)  ^x(2)  I  cva^uat*d  at 

X^j"X^j.  Note  that  knowledge  of  S  and  is  equivalent  to 

knowledge  of  and  X^j*,  thus  Fn  (x  j  |x  ^  j )  is 

PlX^j  <  x  )  |s  ^  1  ^  ,X  (  ^  )  ]  evaluated  at  X^  j  •>  j 

Given  Xjj ,  the  other  observations  X(2)»*(  )**’**^(n)  *re 
distributed  as  an  ordered  sample  of  size  (n-1)  from  an  exponential 
with  origin  X^jj  thus  one  can  obtain  easily 

PlX(2)<  X(2)|S(‘),X(.)’  * 

‘  P|X(2)'X(l)  <X(2)"X(l)  1  i 


the  above  const  deration  yields 


U  lf  X(z)"X(i)<0 


Fn(x(z),X(,))“1  1-I1-^"1><x(2)“x(1)V{S(l)-(n-l)x(j)}]n’ 


,f  X ( j ) ”X ( | )  E  ^0,S  1  "(n“l)X(a)) 


1  elsewhere; 


thus,  Z2-  l-[  l-(n-l)  J/{S^)-(n-l)X(  j}] 
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For  the  computation  of  Fn (x ( , ) I x ( t ) » x( ? ) )  .  the  Markovian 
property  of  the  order  statistics  and  the  fact  that  knowledge  of 
S,X^j  and  is  equivalent  to  that  of  and  x(2)»  yield 

the  following  result; 


Fn(x(9)|x(j),x(2))  is  Plx(,)<x(3)  Is-  X(,)»XX2)1 


evaluated  at  X(l)-x(i),  X(a)-x(a).  But  Pi  X (j)<  x(j) | S ,X(j ) ,X(a)] 


Is  equal  to  Pi x (3 x( } ) I ^ »x ( j ) ,X(2 )1  »  and  9'ven  x(2)»  X(i)  *s 


independent  of  X^j  and  S^2^,  therefore 


HX(j)<x(j)|S(2),  X(j).X(j)I  =  P(X(>)<x(j)|s'^.x,.,]  a.s. 


(l) 


Now,  in  order  to  compute  this  last  conditional  d  i  s  t  r  I  bujt  i  on 

we  observe  that  given  X,  »,  the  set  X,  »,X,  .  »  is  distributed 

I2;  V3  /  V«.  #  In  J 

as  an  ordered  sample  of  size  (n-2)  from  an  exponential  distributio 
with  origin  X^j  so  the  previous  approach  is  repeated. 

By  extending  these  results,  we  have  the  following 


Theorem  for  j  =  1 ,2, . . . ,n-l ,  the  r.v. 


Z 


J 


^  l-(n-j  +  1)X(J.)J/(x(J)t...+X(nj)  j 


where  x(#j  s  0 


12 


ere  l.t.d.  U(0,1)  If  ) »* (a) » * » • •  * jnj  are  ordered  exponentials. 

It  can  now  be  seen  that  the  ICPIT  can  be  written  as  the 
composition  of  previous  characterizations:  ICPIT  -  T  0E0J0R0N. 

Comment.-  Recall  that  K  -  J  o  N,  W  -  E  o  J  and  C  »  I  o  E  o  J,  and 
define  also  M  ®  J  o  R  o  N.  If  In  subsequent  tests  for  uniformity 
we  use  test  statistics  which  give  the  same  value  for  a  set  Z.  as  for 
the  corresponding  set  1  -  Z{,  it  is  clear  that  C  is  equivalent  to 
V  **  E  o  J  (  will  give  the  same  values  of  the  test  statistics) 

and  ICPIT  is  equivalent  to  E  o  J  o  R  o  N.  The  test  statistics  used 
below,  based  on  the  empirical  distribution  function,  have  this 
property.  Note  also  that  since  R  simply  indexes  exponentials  in 
reverse  order,  and  does  not  give  new  values,  me  might  expect  K  and  M  to 
have  the  same  power  properties.  The  step  E  which  appears  in  the  C 
composition  will  have  the  property  that  it  takes  superuniforms, 
which  can  sometimes  be  produced  by  J,  into  samples  which  would  be 
declared  significant  using  the  usual  (upper)  tail  of  the  test 
statistics.  Thus  we  do  not  have  to. guard  against  the  possibility 
of  superuniforms  as  Seshadrl ,  Csorgo  and  Stephens  (1369)  found 
necessary  with  J  alone.  On  the  other  hand,  E  might  sometimes  take 
non-uniform  samples  into  more  evenly  spaced  observations,  thus 
weakening  the  test,  ant*  we  might  find  ICPIT,  for  some  alterna¬ 
tives,  giving  a  sample  which  is  not  so  easily  detected  for  non- 
uniforms  as  M,  or  its  equivalent  K. 


-  is  - 


h.  Power  Studies,  These  points  have  been  examined  by  extensive 
power  studies,  using  C,  ICPIT  and  M.  After  the  samples  were 
taken  From  the  alternatives  listed,  the  statistics  used  for  testing 
uniformity  were  the  Cramer-Von  Mises  W2 ,  Watson  U2,  Kolmogorov- 
Smirnov  D,  Kuiper  V  and  Anderson-Darling  A2.  Tables  1  and  2  give  result 
one  for  sample  size  n=10  and  the  second  for  n»20,  both  with  tests 
of  size  a^O.IO.  These  should  be  compared  for  J  and  K  given  by 
Seshadrl , vCsorgo  and  Stephens  (19&9),  and  more  extensive  tables 
for  K  alone  given  by  Stephens  (1978). 


Comments (a).-  The  presence  of  E  after  J  in  C  does  give  upper  tail 
significance  for  the  samples  from  the  half  normal  distribution  where 
J  alone  gives  superuni  forms ,  as  was  conjectured  above.  C  is  still 
not  as  pov/erful  in  this  case  as  J,  using  the  lower  tail  of  the  test 
statistic,  but  it  must  be  emphasized  that  one  would  not  know  that 
the  lower  tail  is  needed,  so  that  C  is  to  be  preferred  to  J.  (b)  - 
As  conjectured,  M  gives  results  very  close  to  those  given  in 
Stephens  (1978)  for  K  for  a  wide  range  of  alternatives.  (c)  -  In 
general  M  (or  K)  give  results  a  little  better  than  ICPIT,  which 
overall  Is  better  than  C;  in  other  words  the  tranforma t  Ion  related 
to  ICPIT  which  gives  ordered  uniforms  is  preferred  to  ICPIT  which 
gives  unordcred  uniforms.  (d).-  k  is  therefore  justified  again  as 
an  effective  character i zat ion ,  and  the  ICPIT,  which  reproduced-  1C  ,  Is 
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shown  to  provide  a  systematic  approach  to  invariant  characterizations. 
Unfortunately,  for  most  families,  the  ICPIT  will  be  difficult 
computationally;  we  hope  that  this  work  will  stimulate  further 
research  into  the  general  problem  of  finding  invariant  characterizations. 
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Half  cfuchy 


TABLE  2.-  Simulated  power  In  %  for  procedures  C,  I C P I T  and  M  followed 

by  W*,  U  2»  K,  D  and  A*.  Sample  size  n«*20;  significance  level 
a  ■  .10;  500  samples  from  each  distribution. 
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